Image sensor module

ABSTRACT

Various aspects of the present disclosure generally relate to a sensor module. In some aspects, an image sensor module may include an array of photon sensors configured to output a first set of signals corresponding to a set of photon sensors of the array of photon sensors. The set of photon sensors may include a row of photon sensors, or a column of photon sensors, of the array of photon sensors. The image sensor module may include a plurality of data selector components configured to receive the first set of signals and output a second set of signals corresponding to a subset of the set of photon sensors.

FIELD OF THE DISCLOSURE

Aspects of the present disclosure generally relate to sensors and, forexample, to an image sensor module for a user device.

BACKGROUND

Sensors are used within user devices for various purposes. Such sensorsmay be used to sense one or more characteristics associated with theuser device. Such characteristics may include one or morecharacteristics of an environment of the user device. For example, oneor more sensors may be configured to detect whether a user is present,detect motion, measure ambient lighting, capture images of theenvironment or the user for analysis, and/or the like. A head-mounteddisplay may include an inward facing image sensor (e.g., a camera) foreye tracking applications. The image sensor may be used to capture imageinformation regarding an eye, and utilize the image information todetermine information regarding a position of the eye. For example, theimage sensor may be used to determine a gaze direction of the eye.

SUMMARY

In some aspects, an image sensor module includes: an array of photonsensors configured to output a first set of signals corresponding to aset of photon sensors of the array of photon sensors, where the set ofphoton sensors includes a row of photon sensors, or a column of photonsensors, of the array of photon sensors; and a plurality of dataselector components configured to receive the first set of signals andoutput a second set of signals corresponding to a subset of the set ofphoton sensors.

In some implementations, a method includes: determining, by a userdevice, a subset of a set of photon sensors of an array of photonsensors that is to be used for signal acquisition, the set of photonsensors including a row of photon sensors, or a column of photonsensors, of the array of photon sensors, where the array of photonsensors is configured to output a first set of signals corresponding tothe set of photon sensors; and causing, by the user device and based atleast in part on determining the subset of the set of photon sensors, aplurality of data selector components to receive the first set ofsignals and output a second set of signals corresponding to the subsetof the set of photon sensors.

In some implementations, a non-transitory computer-readable mediumstoring a set of instructions includes one or more instructions that,when executed by one or more processors of a user device, cause the userdevice to: determine a subset of a set of photon sensors of an array ofphoton sensors that is to be used for signal acquisition, the set ofphoton sensors including a row of photon sensors, or a column of photonsensors, of the array of photon sensors, where the array of photonsensors is configured to output a first set of signals corresponding tothe set of photon sensors; and cause, based at least in part ondetermining the subset of the set of photon sensors, a plurality of dataselector components to receive the first set of signals and output asecond set of signals corresponding to the subset of the set of photonsensors.

In some implementations, an apparatus includes means for determining asubset of a set of photon sensors of an array of photon sensors that isto be used for signal acquisition, the set of photon sensors including arow of photon sensors, or a column of photon sensors, of the array ofphoton sensors, where the array of photon sensors is configured tooutput a first set of signals corresponding to the set of photonsensors; and means for causing, based at least in part on determiningthe subset of the set of photon sensors, a plurality of data selectorcomponents to receive the first set of signals and output a second setof signals corresponding to the subset of the set of photon sensors.

Aspects generally include a method, apparatus, system, computer programproduct, non-transitory computer-readable medium, user device, userequipment, wireless communication device, and/or processing system assubstantially described with reference to and as illustrated by thedrawings and specification.

The foregoing has outlined rather broadly the features and technicaladvantages of examples according to the disclosure in order that thedetailed description that follows may be better understood. Additionalfeatures and advantages will be described hereinafter. The conceptionand specific examples disclosed may be readily utilized as a basis formodifying or designing other structures for carrying out the samepurposes of the present disclosure. Such equivalent constructions do notdepart from the scope of the appended claims. Characteristics of theconcepts disclosed herein, both their organization and method ofoperation, together with associated advantages will be better understoodfrom the following description when considered in connection with theaccompanying figures. Each of the figures is provided for the purposesof illustration and description, and not as a definition of the limitsof the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

So that the above-recited features of the present disclosure can beunderstood in detail, a more particular description, briefly summarizedabove, may be had by reference to aspects, some of which are illustratedin the appended drawings. It is to be noted, however, that the appendeddrawings illustrate only certain typical aspects of this disclosure andare therefore not to be considered limiting of its scope, for thedescription may admit to other equally effective aspects. The samereference numbers in different drawings may identify the same or similarelements.

FIG. 1 is a diagram illustrating an example environment in which animage sensor module described herein may be implemented, in accordancewith various aspects of the present disclosure.

FIG. 2 is a diagram illustrating example components of one or moredevices shown in FIG. 1, such as a user device, in accordance withvarious aspects of the present disclosure.

FIG. 3 is a diagram illustrating an example of image sensor modules, inaccordance with various aspects of the present disclosure.

FIGS. 4A-4C are diagrams illustrating an example associated with animage sensor module, in accordance with various aspects of the presentdisclosure.

FIG. 5 is a flowchart of an example process associated with an imagesensor module, in accordance with various aspects of the presentdisclosure.

DETAILED DESCRIPTION

Various aspects of the disclosure are described more fully hereinafterwith reference to the accompanying drawings. This disclosure may,however, be embodied in many different forms and should not be construedas limited to any specific structure or function presented throughoutthis disclosure. Rather, these aspects are provided so that thisdisclosure will be thorough and complete, and will fully convey thescope of the disclosure to those skilled in the art. Based on theteachings herein one skilled in the art should appreciate that the scopeof the disclosure is intended to cover any aspect of the disclosuredisclosed herein, whether implemented independently of or combined withany other aspect of the disclosure. For example, an apparatus may beimplemented or a method may be practiced using any number of the aspectsset forth herein. In addition, the scope of the disclosure is intendedto cover such an apparatus or method which is practiced using otherstructure, functionality, or structure and functionality in addition toor other than the various aspects of the disclosure set forth herein. Itshould be understood that any aspect of the disclosure disclosed hereinmay be embodied by one or more elements of a claim.

User devices (e.g., mobile devices, wearable devices, smart eyeglasses,head-mounted display devices, and/or the like) may include one or morecameras to enable the capture of images. A head-mounted display devicemay include an inward-facing camera for use in eye tracking. Eyetracking may be useful in connection with virtual reality (VR)applications, augmented reality (AR) applications, mixed reality (MR)applications, or the like (which may be referred to collectively asextended reality (XR)). For example, eye movements of a user may betracked to determine a direction of the user's gaze, which may be usedas an input for XR applications.

Head-mounted display devices for XR are designed to accommodate a widevariety of head sizes, eye spacings, pupil distances, or the like. Forexample, to accommodate variations in pupil-to-pupil distances across apopulation of users, the inward-facing camera of a head-mounted displaydevice may be configured with a wide field of view to enable eyetracking across the population of users. However, a smaller field ofview may be all that is necessary for eye tracking of a particularindividual user.

A camera may include an image sensor module that includes an array ofphoton sensors arranged in rows and columns. Typically, the array ofphoton sensors is read out one entire row at a time. If less than theentire row is needed (e.g., because the entire field of view of thecamera is not needed for eye tracking of an individual user), the pixelsof interest may be read out with a separate analog to digital converter(ADC), or the row may be shifted until the pixels of interest are readout. However, because the entire row must be read out in order to obtainthe pixels of interest, the use of a portion of a row consumes the sameamount of power and time as using the entire row. Thus, head-mounteddisplay devices, that use an inward-facing camera with a wide field ofview to accommodate a variety of users, may operate relatively slowlyand consume more power and/or processing resources than necessary foreye tracking of an individual user.

Some techniques and apparatuses described herein relate to an imagesensor module that provides improved efficiency, particularly when atotal field of view of the image sensor module is not being utilized fora particular user or a particular operation. The image sensor module mayinclude an array of photon sensors configured to output a set of signalscorresponding to a row of the array. In some aspects, the image sensormodule may include one or more data selector components, such asmultiplexers, configured to receive the set of signals and output asubset of the set of signals (e.g., when the entire row is not beingutilized). For example, the subset of the signals may correspond to asubset of photon sensors of a row of the array. The subset of thesignals may be received by one or more ADCs for conversion to a digitaldomain and further processing (e.g., for use in eye tracking). In thisway, an entire row of photon sensors of the array is not read out orreported when only a portion of the row is to be utilized, therebyconserving processing and/or power resources and improving the speed ofdata transfer and image data acquisition. For example, if the imagesensor module uses a single ADC, the entire row may not be transferredto the ADC. As another example, if the image sensor module uses multipleADCs for columns of the array, the quantity of ADCs may be less than thequantity of photon sensors in the entire row.

FIG. 1 is a diagram illustrating an example environment 100 in which animage sensor module described herein may be implemented, in accordancewith various aspects of the present disclosure. As shown in FIG. 1,environment 100 may include a user device 110, a wireless communicationdevice 120, and/or a network 130. Devices of environment 100 mayinterconnect via wired connections, wireless connections, or acombination of wired and wireless connections.

User device 110 includes one or more devices capable of including one ormore image sensor modules described herein. For example, user device 110may include one or more devices capable of receiving, generating,storing, processing, and/or providing information associated with one ormore sensors described herein. More specifically, user device 110 mayinclude a communication and/or computing device, such as a userequipment (e.g., a smartphone, a radiotelephone, and/or the like), alaptop computer, a tablet computer, a handheld computer, a desktopcomputer, a gaming device, a wearable communication device (e.g., asmart wristwatch, a pair of smart eyeglasses, and/or the like), ahead-mounted display device (e.g., for use in XR), or a similar type ofdevice. As described herein, user device 110 (and/or an image sensormodule of user device 110) may be used to detect, analyze, and/orperform one or more operations associated with eye tracking of a user.

Similar to user device 110, wireless communication device 120 includesone or more devices capable of receiving, generating, storing,processing, and/or providing information associated with one or moresensors described herein. For example, wireless communication device 120may include a base station, an access point, and/or the like.Additionally, or alternatively, similar to user device 110, wirelesscommunication device 120 may include a communication and/or computingdevice, such as a mobile phone (e.g., a smart phone, a radiotelephone,and/or the like), a laptop computer, a tablet computer, a handheldcomputer, a desktop computer, a gaming device, a wearable communicationdevice (e.g., a smart wristwatch, a pair of smart eyeglasses, and/or thelike), a head-mounted display device (e.g., for use in XR), or a similartype of device.

Network 130 includes one or more wired and/or wireless networks. Forexample, network 130 may include a cellular network (e.g., a long-termevolution (LTE) network, a code division multiple access (CDMA) network,a 3G network, a 4G network, a 5G network, another type of nextgeneration network, and/or the like), a public land mobile network(PLMN), a local area network (LAN), a wide area network (WAN), ametropolitan area network (MAN), a telephone network (e.g., the PublicSwitched Telephone Network (PSTN)), a private network, an ad hocnetwork, an intranet, the Internet, a fiber optic-based network, a cloudcomputing network, or the like, and/or a combination of these or othertypes of networks. In some aspects, network 130 may include a datanetwork and/or be communicatively connected with a data platform (e.g.,a web-platform, a cloud-based platform, a non-cloud-based platform,and/or the like) that is capable of receiving, generating, processing,and/or providing information associated with eye tracking operationsperformed by user device 110.

The quantity and arrangement of devices and networks shown in FIG. 1 areprovided as one or more examples. In practice, there may be additionaldevices and/or networks, fewer devices and/or networks, differentdevices and/or networks, or differently arranged devices and/or networksthan those shown in FIG. 1. Furthermore, two or more devices shown inFIG. 1 may be implemented within a single device, or a single deviceshown in FIG. 1 may be implemented as multiple, distributed devices.Additionally, or alternatively, a set of devices (e.g., one or moredevices) of environment 100 may perform one or more functions describedas being performed by another set of devices of environment 100.

FIG. 2 is a diagram of example components of a device 200. Device 200may correspond to user device 110 and/or wireless communication device120. Additionally, or alternatively, user device 110, and/or wirelesscommunication device 120 may include one or more devices 200 and/or oneor more components of device 200. As shown in FIG. 2, device 200 mayinclude a bus 205, a processor 210, a memory 215, a storage component220, an input component 225, an output component 230, a communicationinterface 235, and one or more sensors 240.

Bus 205 includes a component that permits communication among thecomponents of device 200. Processor 210 includes a central processingunit (CPU), a graphics processing unit (GPU), an accelerated processingunit (APU), a digital signal processor (DSP), a microprocessor, amicrocontroller, a field-programmable gate array (FPGA), anapplication-specific integrated circuit (ASIC), and/or another type ofprocessing component. Processor 210 is implemented in hardware,firmware, or a combination of hardware and software. In some aspects,processor 210 includes one or more processors capable of beingprogrammed to perform a function.

Memory 215 includes a random-access memory (RAM), a read only memory(ROM), and/or another type of dynamic or static storage device (e.g., aflash memory, a magnetic memory, and/or an optical memory) that storesinformation and/or instructions for use by processor 210.

Storage component 220 stores information and/or software related to theoperation and use of device 200. For example, storage component 220 mayinclude a hard disk (e.g., a magnetic disk, an optical disk, amagneto-optic disk, and/or a solid-state disk), a compact disc (CD), adigital versatile disc (DVD), a floppy disk, a cartridge, a magnetictape, and/or another type of non-transitory computer-readable medium,along with a corresponding drive.

Input component 225 includes a component that permits device 200 toreceive information, such as via user input. For example, inputcomponent 225 may be associated with a user interface as describedherein (e.g., to permit a user to interact with the one or more featuresof device 200). Input component 225 may include a touchscreen display, akeyboard, a keypad, a mouse, a button, a switch, a microphone, and/orthe like. Additionally, or alternatively, input component 225 mayinclude a sensor for sensing information associated with device 200.More specifically, input component 225 may include a magnetometer (e.g.,a Hall effect sensor, an anisotropic magnetoresistive (AMR) sensor, agiant magneto-resistive sensor (GMR), and/or the like), a locationsensor (e.g., a global positioning system (GPS) receiver, a localpositioning system (LPS) device (e.g., that uses triangulation,multi-lateration, and/or the like), and/or the like), a gyroscope (e.g.,a micro-electro-mechanical systems (MEMS) gyroscope or a similar type ofdevice), an accelerometer, a speed sensor, a motion sensor, an infraredsensor, a temperature sensor, a pressure sensor, and/or the like. Outputcomponent 230 includes a component that provides output from device 200(e.g., a display, a speaker, one or more light-emitting diodes (LEDs),and/or the like).

Communication interface 235 includes a transceiver and/or a separatereceiver and transmitter that enables device 200 to communicate withother devices, such as via a wired connection, a wireless connection, ora combination of wired and wireless connections. Communication interface235 may permit device 200 to receive information from another deviceand/or provide information to another device. For example, communicationinterface 235 may include an Ethernet interface, an optical interface, acoaxial interface, an infrared interface, a radio frequency (RF)interface, a universal serial bus (USB) interface, a Wi-Fi interface, acellular network interface, a wireless modem, an inter-integratedcircuit (I²C), a serial peripheral interface (SPI), or the like.

Sensor 240 includes one or more devices capable of sensingcharacteristics associated with an environment of device 200. Sensor 240may include one or more integrated circuits (e.g., on a packaged silicondie) and/or one or more passive components of one or more flex circuitsto enable communication with one or more components of device 200. Insome aspects, sensor 240 may include a vision sensor (e.g., an imagesensor, an optical sensor, and/or the like), a camera (e.g., alow-resolution camera, a high-resolution camera, and/or the like),and/or the like.

Sensor 240 may include a low-resolution camera (e.g., a video graphicsarray (VGA)) that is capable of capturing low-resolution images (e.g.,images that are less than one megapixel and/or the like). Sensor 240 maybe a low-power device (e.g., a device that consumes less than 10milliwatts (mW) of power) that has always-on capability while device 200is powered on. In some aspects, sensor 240 may include a charge-coupleddevice (CCD) sensor or a complementary metal oxide semiconductor (CMOS)sensor.

Device 200 may perform one or more processes described herein. Device200 may perform these processes in response to processor 210 executingsoftware instructions stored by a non-transitory computer-readablemedium, such as memory 215 and/or storage component 220.“Computer-readable medium” as used herein refers to a non-transitorymemory device. A memory device includes memory space within a singlephysical storage device or memory space spread across multiple physicalstorage devices.

Software instructions may be read into memory 215 and/or storagecomponent 220 from another computer-readable medium or from anotherdevice via communication interface 235. When executed, softwareinstructions stored in memory 215 and/or storage component 220 may causeprocessor 210 to perform one or more processes described herein.Additionally, or alternatively, hardwired circuitry may be used in placeof or in combination with software instructions to perform one or moreprocesses described herein. Thus, aspects described herein are notlimited to any specific combination of hardware circuitry and software.

In some aspects, device 200 includes means for performing one or moreprocesses described herein and/or means for performing one or moreoperations of the processes described herein. For example, the means forperforming the processes and/or operations described herein may includebus 205, processor 210, memory 215, storage component 220, inputcomponent 225, output component 230, communication interface 235, sensor240, and/or any combination thereof. More specifically, device 200includes means for determining a subset of a set of photon sensors of anarray of photon sensors that is to be used for signal acquisition. Insome aspects, the set of photon sensors includes a row of photonsensors, or a column of photon sensors, of the array of photon sensors,and the array of photon sensors is configured to output a first set ofsignals corresponding to the set of photon sensors. Device 200 mayinclude means for causing, based at least in part on determining thesubset of the set of photon sensors, a plurality of data selectorcomponents to receive the first set of signals and output a second setof signals corresponding to the subset of the set of photon sensors.

In some aspects, device 200 may include means for determining the subsetof the set of photon sensors based at least in part on a location of aneye relative to the array of photon sensors. In some aspects, device 200may include means for performing data binning of the first set ofsignals prior to the one or more data selector components receiving thefirst set of signals or data binning of the second set of signals outputby the one or more data selector components. In some aspects, device 200may include means for causing one or more photon sensors, of the set ofphoton sensors, that are not to be used for signal acquisition, toreceive less power relative to the subset of the set of photon sensors.

The quantity and arrangement of components shown in FIG. 2 are providedas an example. In practice, device 200 may include additionalcomponents, fewer components, different components, or differentlyarranged components than those shown in FIG. 2. Additionally, oralternatively, a set of components (e.g., one or more components) ofdevice 200 may perform one or more functions described as beingperformed by another set of components of device 200.

FIG. 3 is a diagram illustrating an example 300 of image sensor modules,in accordance with various aspects of the present disclosure. FIG. 3shows an example image sensor module 305. The image sensor module 305may include a CMOS sensor. The image sensor module 305 may include anarray of photon sensors arranged into rows and columns, and each columnof photon sensors may provide signals to a respective ADC (shown in aColumn ADC row) for conversion to digital values. In some aspects,photon sensor 310 may be used in the image sensor module 305. The photonsensor 310 may be a CMOS photon sensor.

FIG. 3 also shows an example image sensor module 315. The image sensormodule 315 may include a CCD sensor. As above, the image sensor module315 may include an array of photon sensors arranged into rows andcolumns. Here, each column of photon sensors may provide signals to arespective cell of a readout register (e.g., a horizontal shiftregister). The readout register may provide the signals, via horizontalshifting of the signals one-by-one, to a single (e.g., global) ADC forconversion to digital values.

In some aspects, the image sensor module described herein may employ aCMOS-based architecture (e.g., exemplified by the image sensor module305) or a CCD-based architecture (e.g., exemplified by the image sensormodule 315).

As indicated above, FIG. 3 is provided as an example. Other examples maydiffer from what is described with respect to FIG. 3.

FIGS. 4A-4C are diagrams of an example 400 associated with an imagesensor module, in accordance with various aspects of the presentdisclosure. As shown in FIG. 4A, example 400 includes a user device 110,which is described in more detail above in connection with FIGS. 1-2. Inexample 400, the user device 110 is depicted as a head-mounted displaydevice (shown from above) that is worn in front of at least one eye of auser, for example, for XR applications; however, the user device 110 maybe a user equipment or a wearable communication device, among otherexamples. In some aspects, the user device 110 may be associated withnon-XR applications. For example, the user device 110 may be an Internetof Things (IoT) device, such as a smart speaker, a smart camera, or thelike.

The user device 110 includes one or more image sensor modules 405. Theimage sensor module 405 may include a controller (e.g., processor 210),or may be in communication with a controller of the user device 110. Animage sensor module 405 may be, or may be associated with, a camera ofthe user device 110. In some aspects, the camera is an inward-facingcamera used, for example, for eye tracking of a user. For example, ahead-mounted display device, a pair of smart eyeglasses, or the like,may include a first inward-facing camera at a left side for tracking aleft eye of a user, and a second inward-facing camera at a right sidefor tracking a right eye of the user. In some aspects, the camera is anoutward-facing camera used, for example, for position tracking of a useror capturing other objects or areas of interest.

The image sensor module 405 may have a full field of view 450. The fullfield of view 450 may be relatively wide to accommodate a variety ofviews (e.g., to accommodate a variety of eye spacings and/or pupildistances across a population of potential users of the user device110). As shown, only a partial field of view 460 (e.g., a portion of thefull field of view 450) may be needed when the user device 110 is usedin connection with a particular user and/or a particular operation(e.g., eye tracking of a particular user).

FIG. 4B shows an example of the image sensor module 405. As shown inFIG. 4B, the image sensor module 405 may include an array 410 of photonsensors 415. A photon sensor 415 may also be referred to as aphotodiode, a photosite, or a pixel, among other examples. The photonsensors 415 of the array 410 may be arranged into one or more rows andone or more columns. In some aspects, the array 410 may have a 4:3aspect ratio or a 4:1 aspect ratio. In some aspects, sizes of the photonsensors 415 of the array 410 may be non-uniform when the image sensormodule 405 employs one or more data selector components 420, asdescribed below. Thus, photon sensors 415 of the array 410 that arefurther from a center of a row may be wider than photon sensors 415 ofthe array 410 that are nearer to the center of the row (e.g., to improvethe conversion of photons to electrons for photon sensors 415 at edgesof the array 410).

The photon sensors 415 of the array 410 may be configured to output aset of signals corresponding to a row of photon sensors 415 (i.e., acomplete row of photon sensors 415 spanning from a first column to alast column of the array 410). A row of photon sensors 415 of the array410 may be associated with the full field of view 450 (e.g., horizontalfield of view) of the image sensor module 405. The set of signals maycorrespond to a row of photon sensors 415 in the configuration of theimage sensor module 405 shown in FIGS. 4A-4C in which signals are readout in row-based frames. In some aspects, the set of signals maycorrespond to a column of photon sensors 415 (e.g., corresponding to afull vertical field of view of the image sensor module 405) if the imagesensor module 405 is configured so that signals are read out incolumn-based frames. While the description herein is described in termsof a configuration that uses row-based frames, the description hereinapplies equally to a configuration that uses column-based frames (e.g.,by reversing column/row terminology and horizontal/vertical terminologyin the description).

As shown in FIG. 4B, the image sensor module 405 may include one or more(e.g., a plurality of) data selector components 420. The one or moredata selector components 420 may include one or more multiplexers, oneor more logic gates, and/or one or more filters, among other examples.The one or more data selector components 420 may be configured toreceive the set of signals corresponding to a row of photon sensors 415and output a subset of the set of signals that corresponds to a subsetof photon sensors 415 of the row (e.g., a subset of photon sensors 415spanning a quantity of columns that is less than a total quantity ofcolumns of the array 410). The subset of photon sensors 415 may beassociated with the partial field of view 460 (e.g., a portion of thefull field of view 450) of the image sensor module 405. For example, thepartial field of view 460 may align with a location of a user's eye orpupil.

In some aspects, the image sensor module 405 may include a plurality ofdata selector components 420 that are arranged in a hierarchy (e.g.,with at least two levels of the data selector components 420). In someaspects, the image sensor module 405 may include a single data selectorcomponent 420, and the data selector component 420 may include aquantity of inputs corresponding to a quantity of columns in the array410. In some aspects, the image sensor module 405 may include aplurality of data selector components 420, and the plurality of dataselector components may include a quantity of inputs (e.g., in a firstlevel of data selector components 420 when arranged in a hierarchy)corresponding to a quantity of columns in the array 410. The pluralityof data selector components 420 may be grouped into multiple sets thatdefine a precision of the partial field of view 460 (e.g., that isfurther defined by any additional shifting of the signals). For example,increasing the quantity of sets may increase the precision of thepartial field of view 460 (e.g., so that the partial field of view 460may be closely tailored to the size of a user's eye or pupil).

In some aspects, the user device 110 (e.g., a controller of the userdevice 110 or the image sensor module 405) may determine a particularsubset of photon sensors 415 of a row that is to be used for signalacquisition (e.g., that is to be used to obtain the subset of thesignals). For example, the user device 110 may determine the particularsubset of photon sensors 415 based at least in part on a location of auser's eye or pupil relative to the array 410 (e.g., for inward-facingapplications when the user device 110 is worn on the head of the user),based at least in part on a location of one or more objects or areas ina user's environment relative to the array 410 (e.g., for outward-facingapplications when the user device 110 is worn on the head of the user),and/or based at least in part on a location of one or more objects orareas in an environment of the user device 110 relative to the array 410(e.g., for an IoT device or sensor that uses a partial field of view tocapture an object, a person, or an area), among other examples.

In some aspects, the user device 110 may cycle through multiple partialfields of view (e.g., portions of the full field of view 450) todetermine a particular field of view to use for a particular user or aparticular operation. In some aspects, the user device 110 may address(e.g., configure) different inputs of the one or more data selectorcomponents 420, different data selector components 420, and/or differentsets of data selector components 420, to determine the particular subsetof photon sensors 415. For example, the user device 110 may perform ananalysis of different subsets of the signals obtained by addressingdifferent inputs/data selector components 420/sets of data selectorcomponents 420, and select a particular subset of photon sensors 415corresponding to the subset of the signals that best capture an objector area of interest, such as a user's eye or pupil, a person, or anobject or area in an environment of a user or the user device 110, amongother examples. For example, this may be the subset of the signals thatincludes a highest percentage of pixels associated with the object orarea of interest, such as the user's eye or pupil.

In some aspects, the user device 110 (e.g., a controller of the userdevice 110 or the image sensor module 405) may cause the data selectorcomponent(s) 420 to receive the set of signals corresponding to a row ofthe array 410, and to output the subset of the signals corresponding tothe subset of photon sensors 415 of the row. For example, the userdevice 110 may cause the data selector component(s) 420 to output thesubset of the signals based at least in part on determining theparticular subset of photon sensors 415 that is to be used for signalacquisition, as described above. In some aspects, the user device 110may provide one or more control signals (e.g., based at least in part ondetermining the particular subset of photon sensors 415) to the dataselector component(s) 420 to cause the data selector component(s) 420 tooutput the subset of the signals.

In some aspects, the user device 110 (e.g., a controller of the userdevice 110 or the image sensor module 405) may cause one or more photonsensors 415 that are not in the subset of photon sensors 415, andtherefore are not to be used for signal acquisition, to operate in apower saving mode relative to photon sensors 415 that are in the subset.For example, the user device 110 may cause the one or more photonsensors 415 that are not in the subset to receive less power or consumeless power relative to the photon sensors 415 that are in the subset.For example, the one or more photon sensors 415 that are not in thesubset may be turned off. In some aspects, different levels of powersaving modes may be used among the one or more photon sensors 415 thatare not in the subset. For example, photon sensors 415 that are nearerto the portion of a row that encompasses the subset of photon sensors415 may receive relatively more power than photon sensors 415 that arefurther from this portion of the row.

In some aspects, the user device 110 (e.g., a controller of the userdevice 110 or the image sensor module 405) may perform data binning onthe set of signals prior to the set of signals being received at thedata selector component(s) 420. In some aspects, the user device 110(e.g., a controller of the user device 110 or the image sensor module405) may perform data binning on the subset of the signals output by thedata selector component(s) 420. This may enable reduced processing ofimage data obtained by the image sensor module 405.

As shown in FIG. 4B, the image sensor module 405 may include one or more(e.g., a plurality of) ADCs 425. The one or more ADCs 425 may beconfigured to receive the subset of the signals, corresponding to asubset of photon sensors 415 of a row of the array 410, output by thedata selector component(s) 420. The one or more ADCs 425 may beconfigured to convert the subset of the signals to digital values, whichmay be used by the user device 110 for further processing, analysis,image generation, eye tracking, or the like. In some aspects, the imagesensor module 405 may include one or more amplifiers configured toamplify the subset of the signals prior to the subset of the signalsbeing received at the one or more ADCs 425 (e.g., the quantity ofamplifiers may be the same as the quantity of the ADCs 425). In someaspects, the image sensor module 405 may include a readout register 430configured to receive an output of the one or more ADCs 425.

In some aspects (e.g., for a CMOS sensor), a quantity of the one or moreADCs 425 is less than a quantity of photon sensors 415 in a row ofphoton sensors 415 of the array 410. For example, the image sensormodule 405 may include a plurality of ADCs 425 that are respectivelyassociated with columns for the subset of photon sensors 415 of a row.That is, the quantity of the one or more ADCs 425 may be the same as thequantity of columns for the subset of photon sensors 415 of a row. Inthis way, the image sensor module 405 may include relatively fewer ADCs,thereby reducing a size of the image sensor module 405.

In some aspects, the user device 110 may perform one or more operationsusing the image data obtained by the image sensor module 405. That is,the user device 110 may perform the one or more operations using thedigital values output by the one or more ADCs 425. The one or moreoperations may include operations associated with analysis of the imagedata, image generation using the image data, eye tracking using theimage data, or the like.

FIG. 4C shows an example of the image sensor module 405. As shown inFIG. 4C, the image sensor module 405 may include an array 410 of photonsensors 415 and one or more (e.g., a plurality of) data selectorcomponents 420, as described above in FIG. 4B.

In some aspects (e.g., for a CCD sensor), the image sensor module 405may include a readout register 430 (e.g., a horizontal shift register),as described above. The readout register 430 may include a plurality ofcells configured to receive the subset of the signals output by the dataselector component(s) 420. Here, the image sensor module 405 may includea single (e.g., global) ADC 425 configured to receive the subset of thesignals from the readout register 430 (e.g., via horizontal shifting ofthe readout register). In addition, the image sensor module 405 mayinclude an amplifier configured to amplify the subset of the signalsprior to the subset of the signals being received at the ADC 425.

In some aspects (e.g., for a CCD sensor), a quantity of cells in thereadout register 430 is less than a quantity of photon sensors 415 in arow of photon sensors 415 of the array 410 (e.g., the entire row is nottransferred to the readout register 430). For example, the image sensormodule 405 may include a plurality of cells in the readout register 430that are respectively associated with columns for the subset of photonsensors 415 of a row. That is, the quantity of cells in the readoutregister 430 may be the same as the quantity of columns for the subsetof photon sensors 415 of a row. In this way, the image sensor module 405may include a relatively smaller readout register 430, thereby reducinga size of the image sensor module 405.

As indicated above, FIGS. 4A-4C are provided as an example. Otherexamples may differ from what is described with regard to FIGS. 4A-4C.The quantity and arrangement of devices shown in FIGS. 4A-4C areprovided as an example. In practice, there may be additional devices,fewer devices, different devices, or differently arranged devices thanthose shown in FIGS. 4A-4C. Furthermore, two or more devices shown inFIGS. 4A-4C may be implemented within a single device, or a singledevice shown in FIGS. 4A-4C may be implemented as multiple, distributeddevices. Additionally, or alternatively, a set of devices (e.g., one ormore devices) shown in FIGS. 4A-4C may perform one or more functionsdescribed as being performed by another set of devices shown in FIGS.4A-4C.

FIG. 5 is a flowchart of an example process 500 associated with an imagesensor module. In some aspects, one or more process blocks of FIG. 5 maybe performed by a user device (e.g., user device 110). In some aspects,one or more process blocks of FIG. 5 may be performed by another deviceor a group of devices separate from or including the user device, suchas a wireless communication device (e.g., wireless communication device120) and/or an image sensor module (e.g., image sensor module 405).Additionally, or alternatively, one or more process blocks of FIG. 5 maybe performed by one or more components of device 200, such as processor210, memory 215, storage component 220, input component 225, outputcomponent 230, communication interface 235, and/or sensor 240.

As shown in FIG. 5, process 500 may include determining a subset of aset of photon sensors of an array of photon sensors that is to be usedfor signal acquisition, the set of photon sensors including a row ofphoton sensors, or a column of photon sensors, of the array of photonsensors, where the array of photon sensors is configured to output afirst set of signals corresponding to the set of photon sensors (block510). For example, the user device (e.g., using processor 210, memory215, and/or sensor 240) may determine a subset of a set of photonsensors of an array of photon sensors that is to be used for signalacquisition, as described above. In some aspects, the set of photonsensors includes a row of photon sensors, or a column of photon sensors,of the array of photon sensors. In some aspects, the array of photonsensors is configured to output a first set of signals corresponding tothe set of photon sensors.

As further shown in FIG. 5, process 500 may include causing, based atleast in part on determining the subset of the set of photon sensors, aplurality of data selector components to receive the first set ofsignals and output a second set of signals corresponding to the subsetof the set of photon sensors (block 520). For example, the user device(e.g., using processor 210 and/or memory 215) may cause, based at leastin part on determining the subset of the set of photon sensors, aplurality of data selector components to receive the first set ofsignals and output a second set of signals corresponding to the subsetof the set of photon sensors, as described above.

Process 500 may include additional aspects, such as any single aspect orany combination of aspects described below and/or in connection with oneor more other processes described elsewhere herein.

In a first aspect, the plurality of data selector components are tooutput the second set of signals to one or more ADCs.

In a second aspect, alone or in combination with the first aspect, aquantity of the one or more ADCs is less than a quantity of photonsensors in the set of photon sensors.

In a third aspect, alone or in combination with one or more of the firstand second aspects, the plurality of data selector components are tooutput the second set of signals to a plurality of cells of a readoutregister that are configured to output a signal to a single ADC.

In a fourth aspect, alone or in combination with one or more of thefirst through third aspects, a quantity of the plurality of cells isless than a quantity of photon sensors in the set of photon sensors.

In a fifth aspect, alone or in combination with one or more of the firstthrough fourth aspects, the plurality of data selector componentsinclude a plurality of multiplexers.

In a sixth aspect, alone or in combination with one or more of the firstthrough fifth aspects, the plurality of data selector components are ina hierarchy.

In a seventh aspect, alone or in combination with one or more of thefirst through sixth aspects, one or more first photon sensors furtherfrom a center of the row of photon sensors are wider than one or moresecond photon sensors nearer to the center of the row of photon sensors.

In an eighth aspect, alone or in combination with one or more of thefirst through seventh aspects, process 500 includes determining thesubset of the set of photon sensors based at least in part on a locationof an eye relative to the array of photon sensors.

In a ninth aspect, alone or in combination with one or more of the firstthrough eighth aspects, process 500 includes performing data binning ofthe first set of signals prior to the plurality of data selectorcomponents receiving the first set of signals or data binning of thesecond set of signals output by the plurality of data selectorcomponents.

In a tenth aspect, alone or in combination with one or more of the firstthrough ninth aspects, process 500 includes causing one or more photonsensors, of the set of photon sensors, that are not to be used forsignal acquisition, to receive less power relative to the subset of theset of photon sensors.

In an eleventh aspect, alone or in combination with one or more of thefirst through tenth aspects, the array of photon sensors is included inan inward-facing camera for eye tracking of the user device.

Although FIG. 5 shows example blocks of process 500, in some aspects,process 500 may include additional blocks, fewer blocks, differentblocks, or differently arranged blocks than those depicted in FIG. 5.Additionally, or alternatively, two or more of the blocks of process 500may be performed in parallel.

The following provides an overview of aspects of the present disclosure:

Aspect 1: A method, comprising: determining, by a user device, a subsetof a set of photon sensors of an array of photon sensors that is to beused for signal acquisition, the set of photon sensors including a rowof photon sensors, or a column of photon sensors, of the array of photonsensors, wherein the array of photon sensors is configured to output afirst set of signals corresponding to the set of photon sensors; andcausing, by the user device and based at least in part on determiningthe subset of the set of photon sensors, a plurality of data selectorcomponents to receive the first set of signals and output a second setof signals corresponding to the subset of the set of photon sensors.

Aspect 2: The method of aspect 1, wherein the plurality of data selectorcomponents are to output the second set of signals to one or more analogto digital converters.

Aspect 3: The method of aspect 2, wherein a quantity of the one or moreanalog to digital converters is less than a quantity of photon sensorsin the set of photon sensors.

Aspect 4: The method of aspect 1, wherein the plurality of data selectorcomponents are to output the second set of signals to a plurality ofcells of a readout register that are configured to output a signal to asingle analog to digital converter.

Aspect 5: The method of aspect 4, wherein a quantity of the plurality ofcells is less than a quantity of photon sensors in the set of photonsensors.

Aspect 6: The method of any of aspects 1-5, wherein the plurality ofdata selector components comprise a plurality of multiplexers.

Aspect 7: The method of any of aspects 1-6, wherein the plurality ofdata selector components are in a hierarchy.

Aspect 8: The method of any of aspects 1-7, wherein one or more firstphoton sensors further from a center of the row of photon sensors arewider than one or more second photon sensors nearer to the center of therow of photon sensors.

Aspect 9: The method of any of aspects 1-8, further comprising:determining the subset of the set of photon sensors based at least inpart on a location of an eye relative to the array of photon sensors.

Aspect 10: The method of any of aspects 1-9, further comprising:performing data binning of the first set of signals prior to theplurality of data selector components receiving the first set of signalsor data binning of the second set of signals output by the plurality ofdata selector components.

Aspect 11: The method of any of aspects 1-10, further comprising:causing one or more photon sensors, of the set of photon sensors, thatare not to be used for signal acquisition, to receive less powerrelative to the subset of the set of photon sensors.

Aspect 12: The method of any of aspects 1-11, wherein the array ofphoton sensors is included in an inward-facing camera for eye trackingof the user device.

Aspect 13: An apparatus, comprising a processor; memory coupled with theprocessor; and instructions stored in the memory and executable by theprocessor to cause the apparatus to perform the method of one or moreaspects of aspects 1-12.

Aspect 14: A device, comprising a memory and one or more processorscoupled to the memory, the memory and the one or more processorsconfigured to perform the method of one or more aspects of aspects 1-12.

Aspect 15: An apparatus, comprising at least one means for performingthe method of one or more aspects of aspects 1-12.

Aspect 16: A non-transitory computer-readable medium storing code, thecode comprising instructions executable by a processor to perform themethod of one or more aspects of aspects 1-12.

Aspect 17: A non-transitory computer-readable medium storing a set ofinstructions, the set of instructions comprising one or moreinstructions that, when executed by one or more processors of a device,cause the device to perform the method of one or more aspects of aspects1-12.

The foregoing disclosure provides illustration and description, but isnot intended to be exhaustive or to limit the aspects to the preciseform disclosed. Modifications and variations may be made in light of theabove disclosure or may be acquired from practice of the aspects.

As used herein, the term “component” is intended to be broadly construedas hardware, firmware, and/or a combination of hardware and software. Asused herein, a processor is implemented in hardware, firmware, and/or acombination of hardware and software. It will be apparent that systemsand/or methods described herein may be implemented in different forms ofhardware, firmware, and/or a combination of hardware and software. Theactual specialized control hardware or software code used to implementthese systems and/or methods is not limiting of the aspects. Thus, theoperation and behavior of the systems and/or methods were describedherein without reference to specific software code—it being understoodthat software and hardware can be designed to implement the systemsand/or methods based, at least in part, on the description herein.

As used herein, satisfying a threshold may, depending on the context,refer to a value being greater than the threshold, greater than or equalto the threshold, less than the threshold, less than or equal to thethreshold, equal to the threshold, not equal to the threshold, and/orthe like.

Even though particular combinations of features are recited in theclaims and/or disclosed in the specification, these combinations are notintended to limit the disclosure of various aspects. In fact, many ofthese features may be combined in ways not specifically recited in theclaims and/or disclosed in the specification. Although each dependentclaim listed below may directly depend on only one claim, the disclosureof various aspects includes each dependent claim in combination withevery other claim in the claim set. A phrase referring to “at least oneof” a list of items refers to any combination of those items, includingsingle members. As an example, “at least one of: a, b, or c” is intendedto cover a, b, c, a-b, a-c, b-c, and a-b-c, as well as any combinationwith multiples of the same element (e.g., a-a, a-a-a, a-a-b, a-a-c,a-b-b, a-c-c, b-b, b-b-b, b-b-c, c-c, and c-c-c or any other ordering ofa, b, and c).

No element, act, or instruction used herein should be construed ascritical or essential unless explicitly described as such. Also, as usedherein, the articles “a” and “an” are intended to include one or moreitems and may be used interchangeably with “one or more.” Further, asused herein, the article “the” is intended to include one or more itemsreferenced in connection with the article “the” and may be usedinterchangeably with “the one or more.” Furthermore, as used herein, theterms “set” and “group” are intended to include one or more items (e.g.,related items, unrelated items, a combination of related and unrelateditems, and/or the like), and may be used interchangeably with “one ormore.” Where only one item is intended, the phrase “only one” or similarlanguage is used. Also, as used herein, the terms “has,” “have,”“having,” and/or the like are intended to be open-ended terms. Further,the phrase “based on” is intended to mean “based, at least in part, on”unless explicitly stated otherwise. Also, as used herein, the term “or”is intended to be inclusive when used in a series and may be usedinterchangeably with “and/or,” unless explicitly stated otherwise (e.g.,if used in combination with “either” or “only one of”).

What is claimed is:
 1. An image sensor module, comprising: an array ofphoton sensors configured to output a first set of signals correspondingto a set of photon sensors of the array of photon sensors, wherein theset of photon sensors includes a row of photon sensors, or a column ofphoton sensors, of the array of photon sensors; and a plurality of dataselector components configured to receive the first set of signals andoutput a second set of signals corresponding to a subset of the set ofphoton sensors.
 2. The image sensor module of claim 1, furthercomprising: one or more analog to digital converters configured toreceive the second set of signals.
 3. The image sensor module of claim2, wherein a quantity of the one or more analog to digital converters isless than a quantity of photon sensors in the set of photon sensors. 4.The image sensor module of claim 1, further comprising: a readoutregister that includes a plurality of cells configured to receive thesecond set of signals; and a single analog to digital converterconfigured to receive an output of the plurality of cells.
 5. The imagesensor module of claim 4, wherein a quantity of the plurality of cellsis less than a quantity of photon sensors in the set of photon sensors.6. The image sensor module of claim 1, wherein the plurality of dataselector components comprise a plurality of multiplexers.
 7. The imagesensor module of claim 1, wherein the plurality of data selectorcomponents are in a hierarchy.
 8. The image sensor module of claim 1,wherein one or more first photon sensors further from a center of therow of photon sensors are wider than one or more second photon sensorsnearer to the center of the row of photon sensors.
 9. The image sensormodule of claim 1, wherein the image sensor module is included in aninward-facing camera for eye tracking.
 10. A method, comprising:determining, by a user device, a subset of a set of photon sensors of anarray of photon sensors that is to be used for signal acquisition, theset of photon sensors including a row of photon sensors, or a column ofphoton sensors, of the array of photon sensors, wherein the array ofphoton sensors is configured to output a first set of signalscorresponding to the set of photon sensors; and causing, by the userdevice and based at least in part on determining the subset of the setof photon sensors, a plurality of data selector components to receivethe first set of signals and output a second set of signalscorresponding to the subset of the set of photon sensors.
 11. The methodof claim 10, wherein the plurality of data selector components are tooutput the second set of signals to one or more analog to digitalconverters.
 12. The method of claim 11, wherein a quantity of the one ormore analog to digital converters is less than a quantity of photonsensors in the set of photon sensors.
 13. The method of claim 10,wherein the plurality of data selector components are to output thesecond set of signals to a plurality of cells of a readout register thatare configured to output a signal to a single analog to digitalconverter.
 14. The method of claim 13, wherein a quantity of theplurality of cells is less than a quantity of photon sensors in the setof photon sensors.
 15. The method of claim 10, wherein the plurality ofdata selector components comprise a plurality of multiplexers.
 16. Themethod of claim 10, wherein the plurality of data selector componentsare in a hierarchy.
 17. The method of claim 10, wherein one or morefirst photon sensors further from a center of the row of photon sensorsare wider than one or more second photon sensors nearer to the center ofthe row of photon sensors.
 18. The method of claim 10, furthercomprising: determining the subset of the set of photon sensors based atleast in part on a location of an eye relative to the array of photonsensors.
 19. The method of claim 10, further comprising: performing databinning of the first set of signals prior to the plurality of dataselector components receiving the first set of signals or data binningof the second set of signals output by the plurality of data selectorcomponents.
 20. The method of claim 10, further comprising: causing oneor more photon sensors, of the set of photon sensors, that are not to beused for signal acquisition, to receive less power relative to thesubset of the set of photon sensors.
 21. The method of claim 10, whereinthe array of photon sensors is included in an inward-facing camera foreye tracking of the user device.
 22. A non-transitory computer-readablemedium storing a set of instructions, the set of instructionscomprising: one or more instructions that, when executed by one or moreprocessors of a user device, cause the user device to: determine asubset of a set of photon sensors of an array of photon sensors that isto be used for signal acquisition, the set of photon sensors including arow of photon sensors, or a column of photon sensors, of the array ofphoton sensors, wherein the array of photon sensors is configured tooutput a first set of signals corresponding to the set of photonsensors; and cause, based at least in part on determining the subset ofthe set of photon sensors, a plurality of data selector components toreceive the first set of signals and output a second set of signalscorresponding to the subset of the set of photon sensors.
 23. Thenon-transitory computer-readable medium of claim 22, wherein theplurality of data selector components are to output the second set ofsignals to one or more analog to digital converters.
 24. Thenon-transitory computer-readable medium of claim 23, wherein a quantityof the one or more analog to digital converters is less than a quantityof photon sensors in the set of photon sensors.
 25. The non-transitorycomputer-readable medium of claim 22, wherein the plurality of dataselector components are to output the second set of signals to aplurality of cells of a readout register that are configured to output asignal to a single analog to digital converter.
 26. The non-transitorycomputer-readable medium of claim 25, wherein a quantity of theplurality of cells is less than a quantity of photon sensors in the setof photon sensors.
 27. An apparatus, comprising: means for determining asubset of a set of photon sensors of an array of photon sensors that isto be used for signal acquisition, the set of photon sensors including arow of photon sensors, or a column of photon sensors, of the array ofphoton sensors, wherein the array of photon sensors is configured tooutput a first set of signals corresponding to the set of photonsensors; and means for causing, based at least in part on determiningthe subset of the set of photon sensors, a plurality of data selectorcomponents to receive the first set of signals and output a second setof signals corresponding to the subset of the set of photon sensors. 28.The apparatus of claim 27, wherein the plurality of data selectorcomponents are to output the second set of signals to one or more analogto digital converters.
 29. The apparatus of claim 28, wherein a quantityof the one or more analog to digital converters is less than a quantityof photon sensors in the set of photon sensors.
 30. The apparatus ofclaim 27, wherein the plurality of data selector components are tooutput the second set of signals to a plurality of cells of a readoutregister that are configured to output a signal to a single analog todigital converter.